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FOREWORD 


Thi.  report  was  prepared  for  the  Applied  Mathematics  Research  Laboratory, 
Aerospace  Research  Laboratories  by  Dr.  P.  R.  Krishnaiah  under  Project  7071, 
"Research  in  Applied  Mathematics".  It  contains  some  procedures  for  testing 
the  hypothesis  of  equality  of  covariance  matrices  against  different  alternatives 
when  the  underlying  populations  are  multivariate  normal. 

The  author  wishes  to  thank  Miss  Eva  Brandenburg  for  typing  the  manuscript 


carefully. 


ABSTRACT 


Paper,  we  cons.der  the  problem*  o f  testing  for  th.  .quality  of 

zr  ™iri"s  — 

a  fe  m^-riace  normal.  The  alternative  hypothec  considered 

re  (i)  at  least  one  covariance  mu*  • 

Q{  th  TlX  ^  n<>t  e<Jlial  to  the  covariance  matrix 

of  the  next  population,  (ii)  at  lea_*  _ 

'  '  1  iea,,t  °ne  covariance  matrix  i.  -  , 

srix  »*  not  equal  to 

the  covariance  matrix  , 

standard  popnUtinn  and  ,U„  „ 

covariance  matrix  is  not  eoual  *u 

e  covariance  matrix  of  another  population. 
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I .  Introduction  and  Summary 

In  many  situations,  it  is  of  interest  to  test  for  the  equality  of  variances  or 
covariance  matrices  against  certain  alternatives.  Hartley  [6}  considered 
the  problem  of  testing  for  the  equality  of  variances  against  tfce  alternative  that 
at  least  one  variance  is  different  from  the  other.  Gnanadesikan  [3]  considered 
the  problem  of  testing  for  the  equality  of  variances  against  the  alternative  that 
at  least  one  variance  is  not  equal  to  the  standard.  Recently.  Krishiutian  in] 
considered  testing  for  the  equality  of  variances  against  the  alternative  that  at 
least  one  variance  is  not  equal  to  the  next.  In  the  above  procedures,  it  was 
assumed  that  the  underlying  populations  are  univariate  normal.  In  this  paper, 
we  consider  multivariate  generalizations  of  the  above  test  procedures.  The 
test  procedures  proposed  in  this  paper  are  based  upon  expressing  the  total 
hypothesis  as  the  intersection  of  some  elementary  hypotheses  and  testing  these 
elementary  hypotheses  by  using  conditional  distributions.  In  the  two  sample 
case,  our  procedures  are  similar  (but  not  equivalent)  to  the  procedure  proposed 
by  Roy  [14];  the  test  statistics  used  by  him  in  testing  some  of  the  elementary 
hypotheses  are  different  from  those  used  in  this  paper. 


Preliminaries  and  Statement  of  Problems 


Let  S.=  (a.  )  denote  ith  sample  sums  of  squares  and  cross  products  (SP) 

i  tqr 

matrix  and  let  n.+  1  denote  ith  sample  size.  Let  £_  denote  top  jxj  left  hand 

corner  of  2L  =  (o\  )  and  let  S. .  denote  the  top  jxj  left  hand  corner  of  S„  =  (s  ). 
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Also,  let  S..*  =  (s*  )  and  let  -denote  the  common  value  of  o\. (defined  below)when 
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Also,  let 
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In  this  paper,  we  consider  the  problem  of  testing  H  against  A^,  A^  and  A^  where 
H:  V...  .£k.  Aj.  ^  AM1b'  Alj2.  £  Ay,  Ay, 

A  ,=  .£>  A  ..  fc|  A 
3  j^l  3jl  j=  l  3j2 

The  test  procedures  considered  in  this  paper  are  based  on  the  following  method. 
We  first  test  ^  against  the  alternative  of  interest.  If  is  rejected,  we  declare 
that  H  is  rejected.  If  ^  is  accepted,  we  proceed  further  and  test  H^j  and 
holding  the  first  variate  fixed.  If  is  accepted,  we  proceed  further  and  test 

H„,  and  H„,  holding  the  second  variate  fixed.  We  continue  this  proceudre  until  H 
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32 
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is  accepted  or  rejected.  Here  we  note  that  ^  H.,  H,,  is  equivalent  to  the 

j=l  j  =  I  ic 

hypothesis  that 

X,  =  . .  *  ■  X,  i 
lr  kr 

We  need  the  following  known  results  (  see  [14])  in  the  sequel: 

When  S. .  is  fixed,  the  distribution  of  b, .  is  independent  of  the  distribution  of  s  ; 

ij  ij  t.J+1 

the  distribution  of  b. .  is  j-variate  normal  with  mean  vector  8..  and  covariance  matrix 
—ij  '  ~  J 


<rf  ...  S..1  .  and  s?  .  .,/< r?  ...  is  distributed  as  y2  with  (n.-j)  degrees  of 

i.  fl  i*  i.j+1  l.J+l  K  i  6 

f  reedorn. 


3*  Test  for  H  Against  Aj 

The  following  lemma  is  needed  in  the  sequel  . 

Lemma  4. 1 

If  x  ,  x  , .  . .  ,  x,  are  distributed  independently  as  central  chi-square  variates 

1  w  K 

with  m  ,  m  ,  ....  m  degrees  of  freedom,  then 
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The  proof  of  the  above  lemma  is  given  in  [11]. 

We  will  first  consider  the  problem  of  testing  H  ^  against  the  alternative 
A  j  j  i  when  the  first  (j-1)  variates  are  held  fixed  (with  the  understanding  that 
no  variate  is  held  fixed  when  ^is  tested).  In  this  case,  we  accept  if 
and  only  if 


(4.  1) 


X  .  .  S  F.  ...  .  5S  p.  . 
JJ  J.l  +  l.J  JJ 


where  X  ..  and  u.  .  are  chosen  such  that 
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variates  wi,h(vjtl, . fvj+„  degree,  of  freedom.  So.ualng  Lemma  4.1. 

can  write  down  the  joint  distribution  of  F  F  it  u 

12  2  3“  “  '**-  *  >  when 


k-i.k  TTllc"  Hji  is  true 


We  will  now  di.cu.a  about  a  procedure  for  tea, mg  H  again..  A,  when  H. 

3  j| 

is  true  and  when  the  first  j  variates  are  held  fixed. 


A'hen  H.  j  is  true  and  the  first  j  variates  are  held  fixed. 


and  only  if 


we  accept  H.^  if 


(4.  3) 
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»  =  1,2,...,  k-1 


where  c  's  are  chosen  such  that 
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J*  j2  j 

J1  18  true,s.a  j+1^  "o,  j+1  18  dlstr»huted  as  a  chi-square  variate  with 
(  N-k  j)  degrees  of  freedom  and  it  is  distributed  independently  of  D. 


i,  i+1,  ju  for 


1  and  u  1 , 2 , j.  Also,  when  Hj2  is  true,  the  joint 
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is  a  central  multivariate  chi-square  distribution  with  1  degree  of  freed 
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and  t  =  max.  (w,  v);  (for  the  definition  of  the  "accompanying"  multivariate  normal. 

see  [7])  .  So,  the  joint  distribution  of 
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Fk-1 ,  kjj  } 


12 jl ’  k-l,kjl .  12jj’  * 

is  a  multivariate Fdistribution  with  (l,N-kj)  degrees  of  freedom  and  with  O1 
as  the  covariance  matrix  of  the  "accompanying"  multivariate  normal.  For  various 
details  on  the  multivariate  F  distribution,  the  reader  is  referred  to  [9,  10]  . 

Now,  combining  (  4.  1),  (4.  2),  (4.  3)  and  {4.  4)  we  use  the  following  procedure 
for  testing  H  against  . 


Accept  H  against  A^  if  and  only  if 


X*.  <  F.  <  p*. 

ij  i,i+l, j  'ij 


i  =  1, 2, 


k-1  j  =  1 , 2 , 


(4.  5) 
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6. 


where  and  c*  are  chosen  such  that  the  probability  of  (4.5)  holding  good, 

P  P-1 

when  H  is  true,  is  (1  -a).  But  this  probability  is  equal  to  ^11^  q^  Jlj  q'^  where 
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The  optimum  choice  of  the  critical  values  is  not  known.  For  practical  purposes, 
we  impose  the  following  restrictions. 


*1,= 


1  * 


c*  =  c* 
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In  addition,  we  impose  the  restriction  that  the  test  associated  with  testing 
is  locally  unbiased. 

The  (l -a)  %  simultaneous  confidence  intervals  associated  with  the  above  test 
procedure  are  given  by 
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4.  Teat*  for  H  Against  A^  and  A^. 

When  H  ia  teated  against  A^,  we  accept  H  if  and  only  if 


F...  £  b.. 

ikj  ij 

i  =  1,2,. ...k-1  j  =  1,2 . . 

F  sc., 

tkju  ij 
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where  a„,  b_,  c  are  chosen  such  that 
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We  can  evaluate  Qj, ....  Qp  by  using  the  methods  (or  their  modifications)  dis- 
cussed  in  [l ,  4.  5,  8,  1  2  ]  whereas  ,  . .  . ,  can  fce  evaluated  by  using  the 

methods  discussed  in  [  9,  10].  The  optimum  choice  (in  terms  of  increasing  power 
of  the  test)  of  the  critical  values  is  not  known.  But,  for  practical  purposes,  we 
can  choose  them  by  imposing  restrictions  similar  to  those  in  the  previous  section. 

We  will  now  propose  a  procedure  to  test  H  against  when  the  sample  sizes 
are  equal  to  (n+  1).  According  to  this  procedure,  we  accept  H  if  and  only  if 

i/yFiijsvi/i,'I'2 . * 

. k  ••».* . J 

P  P-1 

wher«  a  R.  n,  R!  =  1  -a 
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6. 


Rj=  Pll/XjS  1.2 . kjH^] 

Rj *  p[Fii^ju  *  V  i*4'“  1'2*-*-»k  usl'2 . i | j  1  • 

Using  the  method  discussed  in  [6],  we  can  evaluate  R^, .  .  ..R^.  In  order  to 
evaluate  RJ  .....  B?  ,  we  note  that,  when  H,  is  true  and  j  is  fixed,  the 

1  P“1  i 

statistics  F.  ./  are  jointly  distributed  as  a  singular  multivariate  F  distribution. 
So  it  is  complicated  to  obtain  exact  values  of  Rj .  But,  we  can  obtain  approxi¬ 
mate  values  of  R!  by  using  Bonferronis  inequalities  [2;  p.  100],  For  practical 
purposes,  we  can  choose  the  critical  values  such  that 


R  =  ...  =  R  *  R!  =  ...  =  R  ,  =  ( l-o  ) 
1  pl  P-1 


l/2p- 1 


The  simultaneous  confidence  intervals  associated  with  the  above  test  proce¬ 
dures  can  be  obtained  easily. 


5.  General  Remarks 

Roy  [14]  proposed  a  procedure,  based  on  conditional  distributions,  for  testing 
the  equality  of  two  covariance  matrices.  But,  the  lengths  of  the  confidence  intervals 
associated  with  the  procedures  proposed  in  this  paper  are  at  least  as  short  as 
the  lengths  of  the  corresponding  confidence  intervals  associate  with  the 
procedure  by  Roy  [14],  In  the  univariate  case,  the  procedures  proposed  in  this 
paper  for  testing  H  against  A^,  A^  and  A^  are  respectively  equivalent  to  the  pro¬ 
cedures  considered  by  Krishnaiah  [11],  Gnanadesikan  [3]  and  Hartley  [6]. 
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11  SgeeLCMSNTASV  NOTES 


It.  SNOMSOMNS  MILITANT  ACTIVITY 

Aerospace  Research  Laboratories  (ARM) 
Office  of  Aerospace  Research,  USAF 
Wright- letter  son  AFB.  Ohio 


IS-  ANSTNACT 

la  this  paper,  we  consider;the  problems  of  testing  for  the  equality  of 
covariance  matrices  against  certain  alternatives  when  the  underlying  popu¬ 
lations  are  multivariate  normal.  The  alternative  hypotheses  considered  are 
(i)  at  least  one  covariance  matrix  is  not  equal  to  the  covariance  matrix  of  the 
next  population,  (ii)  at  least  one  covariance  matrix  is  not  equal  to  the  covariance] 
matrix  of  the  standard  population  and  (iH)  at  least  one  covariance  matrix  is 
not  equal  to  the  covariance  matrix  of  another  population. 
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